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1  Introduction 


The  M.I.T.  Artificial  Intelligence  Laboratory’s  Transit  Project  is  develop¬ 
ing  high-perfonnance  networks  for  large-scale  parallel  computers.  One  of 
the  project’s  aims  is  to  make  these  networks  fault-tolerant.  This  has  been 
difficult  in  traditional  multistage  interconnection  networks  for  parallel  com¬ 
puters,  because  these  networks  have  often  been  Banyan  networks  [9,  10]. 
Banyan  networks  do  not  have  redundant  paths  [2],  and  thus  the  failure  of 
a  switching  element  will  necessarily  cut  off  communication  between  at  least 
one  message  source  and  one  message  sink  in  the  network. 

The  addition  of  redundant  paths  can  enhance  fault-tolerance.  Unfortu¬ 
nately,  it  also  creates  problems  for  the  traffic  theorist.  In  a  Banyan  net¬ 
work,  if  one  assumes  messages  at  the  inputs  are  generated  by  independent 
processes,  the  presence  or  absence  of  messages  at  the  inputs  of  any  switch 
in  the  network  is  independent  of  the  presence  or  absence  of  messages  at 
the  other  inputs  of  that  switch.  Thus  the  analysis  of  blocking  probabilities 
in  Banyan  networks  is  simplified  [5].  When  redundant  paths  are  allowed, 
independence  is  violated. 

A  similar  problem  has  been  studied  in  the  context  of  telephone  switching 
systems  [4].  However,  in  telephone  switching  systems  the  model  is  one  of 
a  circtiit-switched  network  where  the  holding  time  for  circuits  varies.  Fur¬ 
thermore,  in  the  methods  described  in  [4],  it  is  assumed  that  the  networks 
modeled  are  symmetric;  because  there  are  classes  of  asymmetric  networks 
that  are  of  interest,  and  because  we  are  partly  interested  in  calculating 
blocking  probabilities  in  the  presence  of  ({symmetric)  faults,  these  methods 
are  not  satisfactory. 

The  number  of  equations  that  must  be  solved  in  order  to  find  the  ex¬ 
act  blocking  probability  of  a  general  network  is  probably  exponential  in  the 
number  of  communications  channels  entering  a  stage  in  a  network;  howevo’, 
there  appears  to  be  no  proof  of  this  in  the  literature.  Still,  even  if  large  prob¬ 
lems  are  intractable,  a  method  of  exact  solution  is  useful  because  it  allows 
some  evaluation  of  approximation  methods  through  comparison  with  exact 


solutions  for  small  problems,  and  also  because  it  can  be  used  as  the  basis  _ 

for  a  Monte  Carlo  approximation  method.  This  is  the  iq>proach  taken  by  sssion  For 
Harvey  and  Hills  in  [3].  Harvey  and  Hills  were  considering  circuit-switched  :  graH  ’ 
telephone  networks  with  unique  paths;  but  their  approach,  which  was  to  TAB 
find  iq>proxiinate  solutioiu  of  exact  equations,  rather  than  exact  solutions  tounced 
to  approximate  equations,  can  still  be  of  use  here.  f  lcatioa_ 
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Figure  1:  An  8x8  deterministically-mterwired  network  with  redundant 
paths.  There  are  a  number  of  different  paths  from  any  source  to  any  sink, 
to  increase  fault-tolerance;  redundant  paths  from  message  source  4  to  sink 
3  are  highlighted.  Routing  is  oblivious,  with  stochastic  concentration.  This 
wirL'ig  scheme  is  from  [1]. 


2  Problem  Statement 

Ccmsider  a  multistage,  unbuffered,  synchronous,  packet-switched  network 
with  redundant  paths.  Such  a  network  might  look  like  the  one  depicted 
in  Figure  1.  Messages  enter  the  network  on  the  channels  leading  from  the 
message  sources,  which  in  Figure  1  are  depicted  on  the  left  side  and  labeled 
Jo  through  Ij.  The  network  has  multiple  stages:  if  we  consider  the  stage 
consisting  of  all  the  sources  to  be  stage  0,  then  stage  1  consists  of  the  column 
of  switching  elements  connected  directly  to  the  sources;  stage  2  the  column 
of  switches  to  the  right  of  stage  1,  etc.  The  message  sinks  are  the  nodes  on 
the  right  side,  labeled  Oq  through  Or. 

The  processes  generating  messages  at  the  sources  are  independent  and 
memoryless.  With  some  specified  probability  pi,  each  source  i  generates 
or  fails  to  generate  a  single  message  at  the  beginning  of  each  cycle.  Each 
generated  message  is  directed  to  a  stage  1  switch  via  one  of  the  channels 
connecting  the  source  to  the  network.  The  channel  by  which  to  send  the 
message  is  chosen  randomly,  and  each  channel  has  the  same  probability  of 
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being  chosen;  i.e.,  routing  is  oblivious.  The  network  is  synchronous:  at  each 
cycle  messages  move  from  stage  i  to  stage  t  +  1.  It  is  also  unbuffered:  if  a 
message  is  blocked  at  some  stage,  it  is  considered  to  be  lost,  and  does  not 
in  any  way  affect  the  future  states  of  the  system. 

In  the  networks  we  model,  the  set  of  output  channels  of  a  switching 
element  is  divided  into  nonempty  disjoint  subsets  called  logical  directions. 
At  each  cycle,  the  switching  element  directs  each  incoming  message  in  one 
logical  direction.  We  assume  uniform  addressing  here;  messages  are  equally 
likely  to  be  addressed  in  any  one  of  the  logical  directions.  We  use  stochastic 
concentration: 

•  If  there  are  fewer  messages  or  exactly  the  same  munber  of  messages 
directed  in  the  logical  direction  as  there  are  channels  in  that  logical 
direction,  then  the  channels  that  will  carry  the  messages  are  chosen 
randomly,  with  uniform  probability. 

•  If  there  are  more  messages  directed  in  a  logical  direction  than  there 
are  channels  in  that  direction,  the  messages  that  can  be  carried  are 
chosen  with  uniform  probability,  and  the  other  messages  are  blocked 
and  lost. 

We  refer  to  a  switching  component  with  M  input  channels  and  N  logical 
directions,  each  consisting  of  K  channels,  as  an  “Af  x  N,  dilation  K  switch.”^ 

Having  defined  our  model,  let  us  return  to  the  network  of  Figure  1.  The 
switches  here  are  4x2,  dilation  2  switches,  except  at  the  last  stage,  where 
they  are  simply  2x2  (dilation  1)  switches.  In  the  4x2,  dilation  2  switches, 
the  top  two  output  channels  constitute  one  logical  direction,  and  the  bottom 
two  constitute  another. 

We  may  state  our  question  as  follows:  What  is  the  probability  that  an 
arbitrary  message  entering  the  network  at  a  channel  leading  from  a  source 
reaches  a  channel  leading  to  a  sink?  We  answer  this  question  by  finding  the 
probability  mass  functions  of  the  loads  on  channels  leading  to  sinks. 

‘One  tnch  ewitch  is  the  RNl  switching  component,  designed  nt  the  M.I.T.  Aztificinl 
Intelligence  Lnborntory’s  Transit  Group.  The  RNl  switching  conqwnent,  intended  for  nse 
in  interconnection  networks  for  parollel  multiprocessors,  is  on  8  x  4,  dilotimi  2  switdi.  It 
is  described  further  in  [7]. 
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Figure  2:  Interstage  wiring.  Note  that  no  subset  of  the  channels  depicted 
need  be  muttially  independent  in  a  network  with  redundant  paths. 

3  The  Joint  Probability  Mass  Function  of  an  Ag¬ 
gregate  of  Channels 

Suppose  that  the  input  channels  of  a  switch  5,  depicted  in  Figure  2,  are 
connected  to  several  switches  Ri,R2i  •  •  •  t  Ri-  Let  us  use  the  random  variable 
L  to  denote  the  entire  output  loading  configuratitm  of  S  at  some  specified 
discrete  time  t,  so  that  P{X  =  /}  is  the  probability  that  the  output  channels 
of  the  switch  have  some  particular  loads  designated  in  their  aggregate  by  I 
during  cycle  t. 

Now  consider  the  loads  on  the  input  channels  Cn, . . . ,  Ci„  at  cycle  t  - 1. 
(Because  we  assume  a  synchronous,  unbuffered  network  with  memoryless 
processes  generating  the  messages  at  the  inputs,  only  the  cycle  before  cycle 
t  is  of  interest.)  Let  us  denote  the  loads  on  the  input  channels  at  cycle  t  - 1 
with  the  random  variables  Xcn ’  ■  ■  * 

In  order  to  find  the  joint  probability  mass  function  of  the  loads  on  the 
output  channels  of  5,  we  condition  on  the  loads  on  the  input  channels: 

ni  =  n=  E  nL  =  i\ lc,,  =  =  ic,.> • 

^Cij 

P{^Cn  =  » •  •  •  >  Lci,  =  }  (1) 

where  the  sum  is  over  all  tuples  /cu  >  •  •  •  >  elements  in  {0, 1}. 
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Figure  3:  Although  the  probabilities  of  the  message  loads  on  the  channels 
Cii, . . . ,  Ci^o  are  not  in  general  independent,  the  loads  on  the  subset  of  chan¬ 
nels  from  each  switching  element  are  independent  given  the  message  loads 
on  the  input  channels  Bu. 


Suppose  that  we  can  compute  ?{£  =  /  |  ic„  =  hn  >  •  •  • » 

In  order  to  compute  the  probability  of  an  output  loading  configuration  of  S 
we  will  stiU  need  to  find  the  joint  probability  mass  function  of  the  channel 
loads  Lcu ,  • .  • ,  Xci,  •  In  a  Banyan  network,  it  would  be  easy  to  compute  this 
function;  it  would  simply  be  the  product  of  the  probability  mass  functions  of 
the  loads  on  the  individual  channels,  as  channel  loads  in  a  Banyan  network 
are  independent.^  In  a  network  with  redundant  paths,  however,  the  loads 
on  these  channels  are  not  in  general  independent,  as  they  may  derive  from 
the  same  sources,  and  a  message  from  a  single  source  that  has  traveled  one 
path  in  the  network  cannot  be  traveling  along  another  path.  Thus  another 
method  must  be  used. 

In  Figure  3,  we  see  that  the  input  channels  of  switch  S 

are  the  output  channels  of  switches  Let  us  call  the  loads  on 

the  input  channels  to  these  switches  Xb, We  may  now  calcu¬ 
late  P{ici,  =  Icn»---»Xc7,„  =  fcj.}  by  conditioning  on  the  values  of  the 
variables  X^,, , . . . ,  Lbh ■  We  have 

P{Xc„  =  Ic:,u---»Xc<.  =  /cj,}  = 

*An  ezptcMioB  for  thk  conditioiMl  probsbilitjr  is  derired  in  Appendix  A. 

*See  Appendix  B. 
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^  ^  ^Cn  >  •  •  •  1  1  ^Bii » •  •  • » ^Bit  ^Bit } 

'»ii . '«ii 

P{i'Bii  =  hii ,  ■  ■  •■.Lbh  =  hi,}  (2) 

where  the  siun  is  over  all  tuples  huf-ihu  with  elements  in  {0,1}. 

The  loads  on  the  output  channels  of  these  switches  are  not  in  general  mu¬ 
tually  independent.  However,  let  us  partition  them  into  subsets  according  to 
the  switch  at  which  they  originate,  so  that  for  the  channels  shown  in  Figure  3 
we  would  have  the  subsets  (Cn, . . .  Ciu} ,  {Cn,. . .  C2*} , . . . ,  {Cn, . . . , 

Note  that,  under  the  assumption  of  uniform  addressing,  and  given  the  loads 
on  the  channels  Hu,...  ,Bit,  the  loads  on  the  switch  output  channel  sub¬ 
sets  are  mutually  independent.  That  is,  if  we  know  the  input  loads  for  the 
switches  Ai, . . . ,  Ai,  then  the  loading  probabilities  for  the  output  channels 
of  each  of  the  switches  do  not  depend  on  the  output  loads  of  any  other 
switch.  We  may  use  this  fact  to  derive  the  joint  probability  mass  function  of 
the  loads  on  the  output  channels  Cu,  •  •  -iCiv,  by  conditioning  on  the  input 
channel  loads.  We  have  then 


P {-^Cji  hii  ?  •  •  •  ?  “  hi^  }  -" 


P^-f'Cj,  ~  >  •  •  •  \  ^B2i  —  ^B*i  >  •  •  • » -^Ba*  •'^Ba#}' 


P{^c<,  =  hi, .  •  •  •  >  Lci^  =  ICi^  I  Lbh  =  hii » •  •  •  >  Lb,,  =  h,, }  • 
Pi^-Bn  =  =  hi,}  (3) 

where  the  sum  is  once  again  over  all  tuples  hu,”  •  ,hi,  with  elements  in 

{0,1}. 

The  conditional  probabilities  can  be  evaluated  as  described  in  Appendix  A, 
and  P{IrB,j  =  hiii’-'^I'Bi,  =  ^Bi,}  can  be  evaluated  recursively  by  means 
of  Equation  (3),  until  the  channels  An,..., Hit  correspond  to  sources.  If 
these  channels  originate  at  message  sources,  then  we  substitute  instead  the 
probability  mass  functions  corresponding  to  sources.  We  may  simply  take 
the  product  of  these  functions  for  the  sources  in  question,  as  in  our  model 
the  processes  generating  messages  at  the  sources  are  mutually  independent. 

If  source  t,  depicted  in  Figure  4,  generates  a  message  with  probability 
Pi  and  has  k  channels  into  the  network,  then  we  have  for  the  loads  on  the 
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Figure  4:  The  source  !{  generates  a  single  message  at  each  cycle  with  prob¬ 
ability  Pi.  The  message  is  transmitted  with  uniform  probability  over  a  ran¬ 
domly  picked  channel  in  the  set  {Ci, . . . 


channels  Ci,  ...,Ck  the  joint  probability  mass  function 


P{^c,  =  =  hk)  = 


I  —  Pi  if  all  the  Icj  are  0 
^  if  exactly  one  Ic,  is  1, 

and  the  rest  are  0 
0  otherwise 


(4) 


4  Automatic  Calculation  of  Blocking  Probabili< 
ties 


It  will  be  clear  that  the  automatic  calculation  of  blocking  probabilities  by 
this  means  will  require  a  great  deal  of  time.  Suppose  we  have  a  computer 
program  that  calculates  the  blocking  probabilities  for  a  network  in  the  most 
obvious  way,  by  finding  the  joint  probability  mass  function  of  the  channels 
leaving  the  final  stage,  using  Equation  (3)  recursively.  In  the  worst  case,  we 
can  imagine  a  network  where  there  are  N  stages  and  Af  dependent  channels 
between  each  of  the  N  stages,  and  the  joint  probability  mass  function  of  all 
of  the  channels  between  each  of  the  stages  must  be  formed.  The  domain 
of  the  joint  probability  mass  function  for  each  stage  then  is  of  size  2^, 
each  value  being  calculated  as  a  sum  over  2^  terms.  Assuming  the  time  to 
calculate  each  of  the  terms  summed  over  in  Equation  (3)  is  0(M ),  we  have 
then  0  for  the  worst-case  poformance. 

The  performance  on  some  networks  can  be  better  than  this,  however. 
Suppose  that  we  need  to  calculate  V{Lci  =  ^Ci  >  •  •  •  i  =  ^c,  }•  1^*  S  (c) 

denote  the  set  of  source  nodes  from  which  messitges  can  reach  channel  c. 
If  we  can  partition  the  set  of  channels  {Ci,...,Cn}  into  disjdmt  subsets 
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Si,...,Sm  such  that  for  any  Ci  G  Si  <uid  Cj  G  Sj,  i  ^  j,  S  (Ci)  n  S  {Ci)  is 
empty,  then  the  loads  on  the  chaimels  in  each  subset  Si  are  independent  of 
the  loads  on  the  channels  in  any  and  all  of  the  other  subsets  in  the  partition.^ 
Then  the  expression  P{icj  =  Ici  >  •  •  • » }  can  be  factored  into  the 
product  of  m  joint  probability  mass  functions,  one  for  each  subset  Si.  In  the 
limiting  case  of  a  B£uiyan  network,  a  complete  factoring  will  be  possible  for 
every  set  of  channels,  and  the  summation  itself  can  be  factored,  so  that  the 
worst  case  performance  for  a  Banyan  network  of  N  stages  with  M  channels 
between  the  stages  becomes  0{NM). 

A  program  has  been  written  to  evaluate  the  joint  probability  mass  func¬ 
tion  of  the  loads  on  specified  channels  in  a  multistage  interconnection  net¬ 
work.  The  program  is  given  a  symbolic  description  of  the  interconnection 
network.  The  program  uses  the  network  representation  to  btiild  an  internal 
structure  in  which  (for  example)  information  about  independence  of  chan¬ 
nel  loads  has  been  precomputed,  and  channeb  have  been  assigned  names 
generated  from  the  names  of  the  their  nodes  of  origin  and  destination.  One 
can  then  assign  message  generation  probabilities  to  the  sources  and  query 
the  program  for  the  probability  mass  function  of  interest.  The  result  is 
numerical,  as  in  the  example  below: 

>  (s«tq  d8x8  (parse-mnltistage-network 

d«t«xninistically-int«r«ired-8x8-r«p}) 
i<iroLTISTlGE-lETVOiU[  8x8> 

>  (jlpml  ’(tt6-o7-0  tt7-o7-0)  d8x8) 

(iS(JLPHF-PART  CHAIIELS  («<CBAIIEL  TT6-07-0> 

#<CHA«EL  Tr7-07-0>) 
lUNBER-OF-CHAIlELS  2 
VECTOR  #(10321939817/17179869184 
2931771091/17179869184 
2931771091/17179869184 
994387185/17179869184) ) ) 

Here  we  have  calculated  the  joint  probability  mass  function  of  the  loads  on 
two  channels  leading  from  two  2x2  switches  to  sink  07  in  the  network 
of  Figure  1,  given  a  probability  of  transmission  in  each  message  source  of 
1/2;  we  assume  here,  as  in  [l],  that  a  message  sink  can  receive  two  messages 
during  a  single  cycle. 

To  find  the  blocking  probability  of  the  network,  we  can  form  the  proba¬ 
bility  of  successful  message  transmission  as  the  ratio  of  the  expected  number 

*At  will  be  seen  from  the  argnment  in  Appendix  B. 
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of  messages  entering  the  network  to  the  expected  number  of  messages  ar¬ 
riving  at  sinks.  Because  of  the  symmetry  of  the  network,  all  the  channels 
leading  to  sinks  have  identical  loading  probabilities,  and  so  we  can  simply 
sum  the  expectations  of  their  loads.  We  have  then  that  the  expected  number 
of  messs^es  arriving  at  a  single  sink  is 

1  •  P{X’TTS-07  =  l»iTT7-07  =  0}  +  1  •  P{-f'TT6-07  =  0,  Z/TT7-07  =  1} 

-i-  2  •  P{I'TT6-07  =  l)iTT7-07  =  1} 

»  0.45” 

and  the  expected  number  of  messages  arriving  at  all  sinks  during  any  cycle 
is  then  8  •  0.457  ss  3.66. 

Because  the  expected  number  of  messages  entering  the  network  is  8  •  |  = 
4,  we  have  that  the  aggregate  probability  of  successful  message  transmission 
in  this  network  at  a  loading  factor  of  1/2  is 

Efmessages  arriving  at  sinks]  ^  ^ 

£[messages  injected  by  sources] 

and  thus  the  blocking  probability  is  approximately  0.086. 

We  plot  for  the  network  of  Figure  1  the  probability  of  successful  message 
transmission  versus  the  probability  that  a  sotirce  transmits  in  Figure  5. 

The  implementation  internally  records  joint  probability  mass  functions 
so  that  they  need  not  be  recomputed.  Although  the  asymptotic  performance 
is  in  general  pessimal,  the  inq>lementation  has  been  coded  with  some  atten¬ 
tion  to  performance,  because  much  of  the  same  code  is  likely  to  be  used  in 
an  approximation  scheme. 

5  Conclusions;  Future  Work 

We  have  presented  a  means  of  exact  calculation  of  the  blocking  probability 
of  a  multistage  network  with  redundant  paths,  and  demonstrated  its  use  in 
a  program  that  automatically  calculates  blocking  probabilities  and  exploits 
independence  of  channel  loading  probabilities  where  this  is  possible. 

The  implementation  described  caimot  be  used  to  calculate  the  blocking 
probabilities  of  networks  with  much  more  path  redundancy  than  the  one 
of  Figure  1.  We  might  consider  an  implementation  that  could  exploit  the 
symmetry  exhibited  by  some  multistage  networks,  but  such  an  implemen¬ 
tation  could  still  not  be  used  on  a  network  like  that  in  Figure  6,  in  which 
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P( Success) 


Figiire  5:  The  probability  of  successful  message  transmission  (P{Success}) 
plotted  against  the  the  source  transmission  probability  (Pi)  for  the  network 
of  Figxire  1. 

the  wiring  in  the  first  and  second  stages  is  not  symmetric  and  is  in  fact 
randomly  generated.  That  such  networks  are  of  interest  is  demonstrated  in 
[6]. 

We  are  investigating  the  possibility  of  approximately  solving  these  sys¬ 
tems  of  equations.  Otir  hope  is  that  the  approximate  solution  of  the  equa¬ 
tions  will  yield  approximations  of  higher  confidence  in  fewer  steps  than  would 
direct  simulation  of  the  network. 
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Figure  6;  A  16  x  16  network  with  random  interwiring  in  the  first  and  second 
stages.  The  figure  is  from  [l]. 


*  ft 


A  Probability  Mass  Functions  of  Switching  Com¬ 
ponent  Output  Channels 

Suppose  we  have  an  M  x  iV,  dilation  K  switch.  We  may  form  the  conditional 
probability  mass  function  of  the  loads  on  the  output  channels,  given  the 
input  load,  by  conditioning.  Say  that  the  random  variable  Lf,g  represents 
the  load  on  the  chaimel  in  the  /***  logical  direction.  Now  for  ease  of 
representation,  let  us  say  that  the  random  variable  L  represents  the  entire 
output  configmation  of  the  switch,  and  takes  on  values  /  that  are  N  x  K 
arrays  whose  elements  lf,g  are  0  if  the  channel  in  question  carries  no  message, 
or  1  if  it  carries  a  message.  Thus  in  our  notation  the  event  we  denote  by 

{L  =  l} 


is  equivalent  to  the  event 

{  -^1,1  =  =  llJCi 

I'i,!  =  ^2,1  >^2,2  =  ^2,2i  •  •  • » =  hjCt 

^N,l  =  ^N,2  =  ^JV,2j  •  •  •  ?  LN,k  =  In,K  } 

We  wish  to  evaluate  the  expression  P{X  =  /  |  Lci  =  Ici  >  •  •  •  >  ~  hn)- 

The  switches  that  we  are  modeling  do  not  distinguish  in  any  way  between 
messages  arriving  at  distinct  input  channels.  Thus  the  loads  on  the  individ¬ 
ual  input  channels  Ci, . . . ,  Cm  are  not  individually  of  significance,  but  their 
sum  is.  Say  that  hi  =  J-  For  simplicity  of  expression,  while  working 
in  an  event  space  where  Lci  -I- . . .  Xcm  ~  superscript  j. 

Thus  we  say  V{L  =  1  j  ic,  =  =  htt)  -  ~  0-  Now,  to 

form  the  conditional  probability  P{L  =  / 1  7  =  y },  we  condition  on  the  num¬ 
ber  of  messages  directed  in  each  logical  direction.  If  the  randmn  variable 
Ci  represents  the  number  of  messages  routed  in  logical  direction  t,  we  can 
condition: 

p{x^  =  /}=  Y.  p{i"  =  n  A  =  =  <!,,}• 

.....Jjv 

P{Di  =  di,...,I?jv  =  dn}  (5) 

where  the  sum  is  over  all  N-tuples  such  that  each  d;  >  0  and 

E.^idi  =  j. 
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Under  uniform  addressing,  the  probability  that  of  the  j  arriving  mes¬ 
sages,  d\  are  directed  in  direction  1,  dj  in  direction  2,  and  so  on,  is  simply 
multinomial,  so  that 

=  =  J(l)'  (6) 

Now  let  us  evaluate  P{i^  =  l\D\=  d\, . . .  ^Dn  =  d„}.  Say  that  a  is  the 
number  of  messages  output  in  direction  i  when  =  /;  that  is,  Ci  =  li,g- 
This  number  is  not  the  same  as  di,  because  if  there  are  more  than  K  messages 
to  be  output  in  a  if-wide  direction,  some  messages  are  dropped  and  lost. 
If  Ci  messages  are  output,  then  under  stochastic  concentration  the  channels 
are  picked  with  uniform  probability,  and  so  the  probability  of  any  single 
configuration  will  be  Thus 


p{z"  =  /|A  =  di,...,Ujv  =  djv}  = 

{0  if  for  any  i,Ci  min  {di,K) 

A  1 

IT  -p:-  otherwise 

i.,  O 

where  Ci  =  kg- 

Combining  Equations  (5),  (6),  and  (7),  we  have 
P{L  =  1 1  Lci  =  lcif---,Lcu  =  ^Ctt)  = 


(7) 


(8) 


where  Ci  =  "^g-ikgi  3  =  and  the  sum  is  over  the  fV- tuples 

di,...,dff  such  that  dj  =  j  and  for  each  i,  c,-  =  min (d,-, K). 


B  Loads  on  Banyan  Network  Channels  at  a  Sin¬ 
gle  Stage  are  Independent 

A  proof  for  the  special  case  of  delta  networks  is  presented  in  [8];  here  we 
present  a  different  proof  for  the  general  case. 

The  proof  is  entirely  straightforward.  Note  first  that,  if  messages  are 
generated  at  source  nodes  by  mutually  independent  random  processes,  and 
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the  sets  of  messages  on  distinct  channels  entering  a  switching  node  origi¬ 
nate  at  disjoint  sets  of  source  nodes,  then  the  loads  on  those  channels  are 
necessarily  independent. 

We  now  claim  that  the  sets  of  messages  on  distinct  ch^umels  entering 
any  switching  node  in  a  Banyan  network  satisfy  this  criterion:  i.e.,  they 
originate  at  disjoint  sets  of  sources. 

For,  consider:  if  chaimel  A  and  channel  B  are  two  channels  entering  a 
switching  node,  and  a  message  on  channel  A  and  a  message  on  channel  B 
originate  at  a  single  somce,  then  it  must  be  the  case  that  at  least  two  paths 
exist  from  that  source  to  any  sinks  accessible  from  the  switching  node:  one 
path  that  uses  channel  A  and  one  that  uses  channel  B.  But  this  is  impossible 
in  a  Banyan  network,  as  Banyan  networks  are  in  fact  those  in  which  there 
is  exactly  one  path  from  each  source  to  each  sink. 

Thus  the  sets  of  messages  on  distinct  chaimels  entering  any  switching 
node  in  a  Banyan  network  must  originate  at  disjoint  sets  of  sources,  wd  so 
the  loads  on  the  channels  entering  any  switching  node  in  a  Banyan  network 
must  be  mutually  independent,  as  was  to  be  proved. 


References 

[1]  Chong,  F.,  Egozy,  E.,  and  DeHon,  A.  “Fault  Tolerance  and  Performance 
of  Multipath  Multistage  Interconnection  Networks,”  in  Advanced  Re~ 
search  in  VLSI:  MIT/Brown  Conference  1992,  edited  by  Thomas  F. 
Knight  Jr.  and  John  Savage,  MIT  Press,  to  be  published  March  1992. 

[2]  Goke,  L.  R.,  and  Lipovski,  G.  J.  “Banyan  Networks  for  Partitioning 
Multiprocessor  Systems,”  in  Proceedings  of  the  First  Annual  Sympo¬ 
sium  on  Computer  Architecture,  1973. 

[3]  Harvey,  C.,  and  Hills,  C.  R.  “Determining  Grades  of  Service  in  a 
Network,”  in  Ninth  International  Teletraffic  Conference,  Torremolinos, 
Spain,  October,  1979. 

[4]  Hiii,  J.  Y.  “Switching  and  Traffic  Theory  for  Integrated  Broadband 
Networks,”  pp.  246-270.  Kluwer  Academic  Publishers,  Boston,  1990. 

[5]  Knight,  T.  F.,  and  Sobalvarro,  P.  G.  “Routing  Statistics  for  Unqueued 
Banyan  Networks.”  M.I.T.  Artificial  Intelligence  Laboratory  Memo  No. 
1101,  September,  1990. 


14 


[6]  Leighton,  T.,  and  Maggs,  B.  “Expanders  Might  be  Practical:  Fast  Algo¬ 
rithms  for  Routing  Around  Faults  in  Multibutterflies,”  in  30th  Annual 
Symposium  on  Foundations  of  Computer  Science,  IEEE  Computer  So¬ 
ciety  Press,  November,  1989. 

[7]  Minsky,  H.,  DeHon,  A.,  and  Knight,  T.  F.  “RNl:  Low-latency,  Dilated, 
Crossbar  Router,”  in  Hot  Chips  Symposium  III,  1991. 

[8]  Patel,  J.  H.  “Performance  of  Processor- Memory  Interconnections  for 
Multiprocessors,”  in  IEEE  Transactions  on  Computers,  Vol.  C-30,  No. 
10,  October  1981. 

[9]  Pfister,  G.  F.  et  al.,  “The  IBM  Research  Parallel  Processor  Prototype 
(RP3):  Introduction  and  Architecture,”  in  Proceedings  of  the  1985  In¬ 
ternational  Conference  on  Parallel  Processing,  August,  1985. 

[10]  Rettberg,  R.,  and  Thomas,  R.  “Contention  is  no  Obstacle  to  Shared- 
Memory  Multiprocessing,”  in  Communications  of  the  ACM,  Vol.  29, 
No.  12,  December,  1986. 


15 


